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EFFICIENT PERCEPTUAL/PHYSICAL COLOR SPACE 

CONVERSION 

TECHNICAL FIELD 

This invention relates to color representation in color imaging systems, and more 
particularly relates to efficiently converting between representations in perceptual and 
physical color spaces. 

BACKGROUND AND SUMMARY 

Color in color imaging systems generally is represented as vector coordinates in a 
three dimensional "color space." Common examples include the well-known RGB, YIQ 
and YUV color spaces. The RGB color space specifies a color using coordinates that 
represent intensities of red, green and blue light, respectively (also known as "tristimulus" 
values). The RGB color space is well suited for output devices such as CRT (cathode ray 
tube) computer monitors, which produce color by exciting red, green and blue phosphors 
with an electron beam at varying intensity. 

A default, standard RGB color space (termed the "sRGB" color space) has been 
defined to support the unambiguous interchange of color image data between devices with 
differing color reproduction characteristics (e.g., between scanners, displays, printers, 
cameras and other imaging devices, which may have different gamut, as well as red, green 
and blue color reproduction chromaticities and luminance). (See, International 
Electrotechnical Commission, "Colour Measurement And Management In Multimedia 
Systems And Equipment," IEC61966-2-1 (1998).) 

The sRGB color space is a perceptual color representation, which represents the 
appearance to a viewer of color on a reference monitor under reference viewing conditions. 
The coordinates in the sRGB color space have a non-linear relationship to actual luminance 
in the three respective chromaticities that closely fits a simple power fimction of exponent 
2.2. (This exponent is sometimes referred to as the color space's "gamma" or y). This 
perceptual color space is advantageous in that it closely matches the native color space of 
many devices (e.g., displays, scanners and digital cameras). For example, common CRT 



1 



# • 

SAW.mlt 3382-56903 MS 155514.2 Express Mail Label No. EL696106165US 

PATENT 

displays have a non-linear relationship of electron-gun voltage to phosphor luminance also 
fitting an exponential function. 

It has been shown, however, that perceptual color spaces are not ideally suitable for 
many standard image-processing operations, such as filtering, anti-aliasing and blending. 
For best results, these image processing operations ideally should be performed using a 
physical color representation having a linear relationship to light intensity (i.e., y^l). (See, 
e.g.. Ward Larson, Greg and Rob Shakespeare, Rendering with Radiance, Morgan- 
Kauf&nan (1998).) An example of a physical color space is the scRGB color space, 
described in lEC 61966-2-2. 

As per the sRGB standard, the conversion between the perceptual sRGB color space 
and a physical color space is defined using the following equations. (The sRGB color 
values are integer numbers in the range 0 to 255, whereas physical color values are floating 
point numbers in the range 0 to 1.) 



^'sRGB-^sbi, -^255.0 
G\RGB = Gsbi, -5-255.0 
B\,,s = B,,, ^255.0 


(1) 


^ _{ ^'.^c. ^12.92 if /?',,^,< 0.03928 
'"^^ \[{R\jfCB +0.055)/l.055f* otherwise 

^ _j G\,^,^\2.92 if G',,^«< 0.03928 
SRGB |[((j.^^^^+o.055)/1.055]" otherwise 

^ _j B\,^,^12.92 if 5',,^, < 0.03928 
SRGB |[(5.^^^^+o.055)/1.055f'' otherwise 


(2) 


The inverse transform (i.e., physical color space to sRGB color space) is as follows. 


^, _r 12.92 xi?,,^^ if /?,„^,< 0.00304 
""'^ \\. 055 xR^^J""^'^ -0.055 otherwise 

r 12.92 xG,,^, if G,,c,< 0.00304 
[\.055xG,,J°'''^ -0.055 otherwise 
^, _f 12.92x5,,^, if 5,,^, < 0.00304 
|l .055 x5,j,cs^'°^"^- 0.055 otherwise 


(3) 
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As can be seen from the above equations, these conversions involve calculating 
power functions with the exponent, 2.4. The calculation of such a power function using a 
floating-point instruction on conventional microprocessors consumes a relatively long time 
to compute. Further, given constraints on cache memory during image processing, an 
implementation of the conversion as a large look-up table also would be slow. 
Consequently, it becomes impractical to perform the perceptual-to-physical color space 
conversion for anti-aliasing and like image processing, and the reverse physical-to- 
perceptual color space conversion during real-time image renderings with such 
implementations. 

A like problem arises with other perceptual color spaces that also ideally would be 
converted to physical color space representations for some image processing operations. For 
example, a CRT monitor that has y=2.5 relationship of electron gun voltage to phosphor 
luminance would ideally convert images between representations using a device-specific 
RGB color space (with Y=2.5) and a physical color space (y=1) for blending and anti- 
aliasing image processing operations. 

The present invention provides efficient conversion between perceptual (y^l) and 
physical (y=1) color spaces, and like applications involving difficult to calculate exponents. 
In accordance with the invention, a conversion involving a computationally expensive 
power function(s) of a variable is implemented by mathematically combining the results of 
any number of computationally less expensive functions of the variable. Such 
computationally less expensive functions generally are functions that can be composed of a 
small number of square roots, reciprocal square roots, reciprocals, multiplications and/or 
additions and subtractions. The combination of computationally less expensive functions 
can be an arithmetic mean, harmonic mean, weighted sum or difference, or other 
mathematical combination of the functions. 
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In accordance with one aspect of the invention, the computationally less expensive 
functions are composed of a small number of single instruction multiple data floating-point 
(SIMD FP) instruction set operations. Such SIMD FP operations on modem processors 
allow software to use single instructions to perform a same floating-point operation on 
packed operands, such as a range of multiple consecutive color values in an image. 

In accordance with one embodiment of the invention for sRGB/physical color space 
conversions for example, the power function of exponent 2.4 (i.e., x^ in the sRGB to 
physical color space conversion is approximated utiHzing the following weighted harmonic 
mean: 

1.285 



10 0. 7 

p (0.285 + jc-°'K' 

''■'4 



The expressions x' and x can be computed quickly with two and one SIMD FP 
instructions, respectively. Specifically, x' is the square of the reciprocal, and x is the 



reciprocal square root. 



On the other hand, the inverse power x^^^ in the inverse physical-to-sRGB 
15 conversion can be approximated with a weighted arithmetic mean of the two functions x^^ 
and x^^^^, both of which are computationally inexpensive on a processor where the square 
root is computationally inexpensive. The fimction x^^^^ can be evaluated as three successive 
square roots. 

Alternatively, the fimction x'^^'"^ can be evaluated using a Newton-Raphson iteration 



20 for the cube root ( x'^' ' = Vx^ ). 

More generally, alternative embodiments of the invention for perceptual/physical 
color space conversion approximate a conversion involving a power fimction with exponents 
in the range between 1 .7 and 2.5 (e.g., the sRGB power fimction x^ as a combination of 
one or more of the computationally less expensive fiinctions. Examples of such 

25 computationally less expensive fimctions include power fiinctions with exponents in the 

range between 1 and 3 composed fi'om square, square root and reciprocal operations, such as 
the following: 
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X^'^ = X'X•^^X 

For the conversion from physical back to sRGB or other perceptual color space, the 
ahemative embodiments approximate the inverse power function x"'^^ (or other power 
function with exponent in the range of -1/1 .8 and -1/2.5) as a combination of one or more 
inverse power functions in a similar range. Some examples include: 




x''=^r^ 

Additionally, the invention can be applied to efficiently approximate 
computationally expensive power functions in other perceptual/physical conversion 
applications in addition to imaging, such as perceptual/physical conversion of audio and 
touch data. Further, the efficient approximation of power functions according to the 
invention can be employed in applications other than those involving perceptual/physical 
data conversions that require evaluation of computationally expensive power functions. 

Additional features and advantages will be made apparent from the following 
detailed description of the illustrated embodiment, which proceeds with reference to the 
accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a block diagram of an imaging system that implements efficient 
perceptual/physical color space conversion according to an illustrated embodiment of the 
invention so as to permit image processing of an image in the physical color space. 

Figure 2 is a C program listing of a conversion method fi-om a perceptual (sRGB) 
color space to a physical color space in the imaging system of Figure 1 . 

Figure 3 is a C program listing of a conversion method fi*om a physical color space 
to a perceptual (sRGB) color space in the imaging system of Figure 1 . 

Figure 4 is a C program listing of an altemative conversion method fi-om a physical 
color space to a perceptual (sRGB) color space in the imaging system of Figure 1. 

Figures 5 and 6 are a C program listing of a conversion method using SIMD FP 
instructions fi"om a perceptual (sRGB) color space to a physical color space in the imaging 
system of Figure 1. 

Figure 7 is a C program listing of a conversion method using SIMD FP instructions 
fi-om a physical color space to a perceptual (sRGB) color space in the imaging system of 
Figure 1. 

Figure 8 is a C program listing of an altemative conversion method using SIMD FP 
instructions fi'om a physical color space to a perceptual (sRGB) color space in the imaging 
system of Figure 1. 

Figure 9 is a block diagram of a computer system employing the imaging system of 
Figure 1. 



With reference to Figure 1, one implementation of efficient perceptual/physical color 
space conversion according to the invention is embodied in an imaging sub-system 100 in a 
personal computer operating system (e.g., the Graphics Display Interface (GDI) of the 
Microsoft Windows operating system). This imaging sub-system 100 serves to display 
graphics images that form part of the operating system's user interface, as well as displays 
for applications run on the operating system platform, on the computer's monitor 104. In 
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Other embodiments, the efficient perceptual/physical color space conversion can be 
implemented in other imaging systems, such as may form part of application software, 
operating system, firmware or hardware whether on a personal computer, computer 
workstation, server computer, laptop, handheld computer, computer peripheral device, 
audio-video equipment, scanner, printer, camera, television, set-top box, game console, or 
other device that performs image processing. 

The imaging system 100 includes a perceptual image processor 1 10 and a physical 
image processor 120. The perceptual image processor 110 performs processing on image 
data (e.g., sRGB images 112-114) represented using a perceptual color space. The 
perceptual color space has a non-linear relationship of color value to light intensity or non- 
unity gamma (y^l). The perceptual color space used in the perceptual image processor 1 10 
of the illustrated imaging system 100 is the sRGB color space. Alternatively, other 
perceptual color spaces can be used, such as a device-specific RGB color space having a 
gamma corresponding to the relationship of electron gun voltage to light intensity of the 
respective monitor 104. The perceptual color space in alternative implementations also can 
be a color space using other than red, green and blue coordinates. The perceptual image 
processor 110 provides image processing operations that are best performed in the 
perceptual color space, such as rendering or displaying the image to the computer monitor 
104 and gamut mapping. 

The physical image processor 120 in the illustrated imaging system 100 performs 
image processing operations that are more ideally performed on image data represented in a 
physical color space (e.g., physical images 122-124). The physical color space has a linear 
relationship of color value to light intensity. In the illustrated imaging system 100, the 
physical color space is a 32-bit RGB color space with unity gamma (y=l), i.e., each of the 
red, green and blue coordinates is represented as a 32-bit floating point value in the range 0 
to 1 .0 directly relating to the light intensity of that color. Altematively, other pixel 
representations, such as fixed point integer values, and physical color spaces, including non- 
RGB color spaces, can be used. The image processing operations performed in the physical 
image processor 120 can include, for example, filtering, blending and anti-aliasing 
operations. 
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The illustrated imaging system 100 also includes a perceptual/physical image 
converter 130 that implements efficient perceptual/physical color space conversion between 
the sRGB images 1 12-1 14 and the physical color space images 122-124. Typically, the 
images processed in the illustrated imaging system 100 are originally represented in the 
5 sRGB color space, because the sRGB images originate from other devices (e.g., an image 
capturing device, such as a scanner or camera) and the sRGB color space is used as the color 
interchange standard between that device and the imaging system. Further, the images 
typically are displayed directly from their representation in the sRGB color space by the 
perceptual image processor 1 10 in the illustrated imaging system 100. In between, the 
10 images typically are subjected to the various image processing operations that are more 
^3 ideally perfr)rmed by the physical image processor 120 while in their physical color space 

representation. Consequently, the speed of converting the images between perceptual and 
physical color space representations for processing operations in the respective perceptual 
and physical image processors 110, 120 affects the performance of the imaging system 100, 
15 particularly for real-time imaging appHcations (e.g., video, animations, etc.). 

As discussed in the background above, the conversion from the sRGB color to the 
ly 32-bit RGB color space, and back again involves a power fimction with exponent of 2.4, 

which on conventional computer processors is computationally expensive to solve using a 
Q floating point power fiinction instruction. The efficient perceptual/physical image 

20 conversion performed in the converter 130 approximates this computationally expensive 

exponential fimction in the perceptual/physical conversion by mathematically combining the 
results of a number of computationally less expensive ftmctions of the color value. 

More particularly, the converter 130 approximates the fiinction x^ in the sRGB to 
physical color space conversion (equation 2 listed in the background above) utilizing a 
25 weighted harmonic mean involving square, square root and reciprocal fiinctions, as follows: 

2.4 1.285 
^ (0.285 + jc-'*')jc-' 

This expression can be evaluated using computationally relatively inexpensive floating-point 
operations. In comparison to the computational expense of evaluating the function x^^ using 
a floating point instruction set, this expression can be evaluated as a combination of floating 



SAW:mli 3382-56903 MS 155514.2 Express Mail Label No. EL696106165US 

PATENT 

point instructions for square, square root, reciprocal, addition, subtraction, and 
multiplication operations that is less computationally expensive on a conventional processor. 
The weighting factor used in this weighted harmonic mean expression yields an absolute 
error of 1/1012 within the allowed range of sRGB color values. 
5 Figure 2 illustrates a C program listing 200 of a procedure that implements the just- 

described efficient sRGB to physical color space conversion. 

For the physical to sRGB conversion, the converter 130 approximates the inverse 
power function x^^^ utilizing a weighted arithmetic mean of the functions x^^ and x^'^^^, 
which also can be evaluated using square, square root and reciprocal floating point 
10 instruction operations. In a first altemative, the following weighted arithmetic mean 
expression is used: 

_I/2.4 0.5 , /I ,.A_0.375 



p where the function x^^^^ is evaluated using the following expression: 



^0.375 _ 



s 

13 15 With the weighting factor (w) in this expression equal to 0.362916, the expression yields a 
;2 worst-case absolute error of about 1/770 over the range O^x^l . 

^0 Figure 3 illustrates a C program listing 300 of a procedure to evaluate this first 

altemative of the efficient physical to sRGB color space conversion. 

The first altemative expression for the sRGB conversion uses three successive square 
20 root floating point operations, which can introduce latency in the conversion. A second 

altemative expression eliminates the successive square root operations to reduce latency by 
combining a Newton-Raphson iteration for evaluating the cube roQt together with the 

observation that jc^'* = ifx^ . A weighted arithmetic mean of x^^ and x*^^^ (which can be 
computed as two square roots) generates an estimate for input to the Newton-Raphson 
25 iteration. This produces the following expression approximating the function x^^^'^: 



y-0.78x^'+0.22x'*'' 

-0.00025 
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The subtraction of 0.00025 in the above expression yields a more precise approximation 
because the preceding terms err sHghtly on the positive. 

Figure 4 illustrates a C program listing 310 of a procedure to evaluate this second 
ahemative of the efficient physical to sRGB color space conversion. 

The above-described expressions yield accurate approximations of the functions 
and x'^ using arithmetic combinations of computationally inexpensive square, square root 
and reciprocal operations. In altemative implementations of the perceptual/physical image 
converter 130, these functions can be approximated using arithmetic combinations of other 
computationally inexpensive functions. Such computationally less expensive functions 
generally are functions that can be composed of a small number of square roots, reciprocal 
square roots, reciprocals, multiplications and/or additions and subtractions. The 
combination of these computationally less expensive functions can be an arithmetic mean, 
harmonic mean, weighted sum or difference, or other mathematical combination of the 
functions. 

For approximating the power function x^ in the sRGB/physical color space 
conversion (as well as other perceptual/physical color space conversions involving a power 
function with exponent in the range between 1.7 and 2.5), suitable computationally less 
expensive functions are generally other power functions in a similar range (e.g., 1.7 to 2.5), 
which can be composed as a product of one or more square, square root, reciprocal 
operations. Examples of suitable computationally less expensive functions in this range 
include the following: 

x''=x4^ 
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For the conversion from physical back to sRGB (or other perceptual) color space, 
suitable functions that can be combined to approximate the inverse power function x"'^ (or 
other inverse power function in the range -1/1 .7 to -1/2.5) are inverse power functions in a 
similar range. Some examples include: 



In alternative embodiments of the invention, the imaging system 100 can perform 
efficient conversion between perceptual and physical color spaces other than sRGB and 8- 
bit RGB color spaces. For example, the perceptual color space can be a device-specific 
RGB color space, such as a color space of a CRT monitor, which typically have a gamma in 
the range of 1 .7 to 2.5. In such cases, the perceptual color space may have a gamma 
differing fi-om that of sRGB, and thus the conversion involves approximating a 
computationally expensive power function other than y^'^. The efficient conversion in this 
alternative imaging system approximates the computationally expensive power function as 
an expression combining computationally less expensive floating point operations. Again, 
the computationally expensive floating point operations used in the alternative imaging 
system can be composed of a small number of square roots, reciprocal square roots, 
reciprocals, multiplications and/or additions and subtractions. The combination of these 
computationally less expensive functions can be an arithmetic mean, harmonic mean, 
weighted sum or difference, or other mathematical combination of the functions. 

In alternative embodiments of the invention, the imaging system 100 also can 
perform conversions between perceptual color spaces and other physical color spaces, 
including as another example the scRGB physical color space described in scRGB, lEC 



Further, although the target physical color space generally has a unity gamma (y=1), 
the perceptual to physical color space conversion may leave a range or ranges of color 





61966-2-2. 
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values in the physical color space to have a non-unity gamma. For example, the conversion 
to physical color space can convert color values that are within the range of visible or 
displayable range of color values (e.g., color values between 0.0 and 1.0 in the illustrated 
color space) to have unity gamma, while leaving under- and over-range color values (e.g., 
color values less than black or 0.0 and above white or 1.0 in the illustrated color space) un- 
altered. The resulting physical color space has a unity gamma within one range (e.g., color 
values of 0.0 to 1 .0), and a non-unity gamma outside of that range. In other alternative 
embodiments, the converted color values can be limited to the maximum or minimum of the 
color space (e.g., 0.0 and 1.0). With reference now to Figures 5-8, the efficient 
perceptual/physical image conversion utilizing the above-described expressions to 
approximate the power functions x^ and x'^^ is well adapted for implementation on 
modem microprocessors using a single instruction, multiple data (SIMD) floating point (FP) 
instruction set, such as the 3DNow instructions of some current AMD microprocessors and 
the SSEl instructions of some Intel microprocessors. The SIMD FP instruction sets allow a 
software program to use single instructions to perform multiple floating point operations on 
packed operands. A C program listing 400-401 shown in Figures 5 and 6 implements the 
efficient sRGB -to-physical conversion discussed above using SIMD FP instructions. A C 
program listing 500 shown in Figure 7 implements the efficient physical-to-sRGB 
conversion using the first alternative expression discussed above with SIMD FP instructions. 
Finally, a C program hsting 510 shovra in Figure 8 implements the efficient physical-to- 
sRGB conversion using the second alternative expression discussed above with SIMD FP 
instructions. 

The C code in Figures 5-8 uses special data types and intrinsic fiinctions to access 

the Intel SSEl instruction set. The ^ml28 data type is a 128-bit word that contains four 

packed 32-bit floating point values. Intrinsic fimctions that operate on this data type evaluate 
to SSEl instructions that use the SSEl registers and instructions. For example, calling the 
function _mm_mul_ps causes the compiler to generate a MULPS instruction, which 
performs four multiplications on corresponding floating point values in the two 128-bit 
operands. Similar code may be developed using other languages or development 



12 



SAW:mit 3382-56903 MS 155514.2 Express Mail Label No. EL696106165US 

PATENT 

technologies such as assemblers, and may target other instruction sets such as 3DNow or 
similar instruction sets on non-x86 compatible microprocessors. 

With reference to Figure 9, an exemplary computer 600 that incorporates the 
illustrated imaging system 100 (Figure 1) typically is configured to include a processing unit 
602 (e.g., a microprocessor or micro-controller) and system memory 604. In some 
embodiments, the processor is a microprocessor providing a SIMD FP instruction set, such 
as the AMD 3DNow instructions or the Intel SSEl instructions. Depending on the exact 
configuration and type of computing device, the system memory may be volatile (such as 
RAM), non-volatile (such as ROM, flash memory, etc.) or some combination of the two. 
Additionally, the computer 600 may also have mass or secondary storage (removable 606 
and/or non-removable 607) such as magnetic or optical disks or tape. Similarly, the 
computer 600 may also have input devices 610 such as a keyboard, pointing device, 
microphone, etc., and/or output devices 612 such as display, speaker, printer, force- 
feedback, etc. The computer 600 also typically includes network connections 620 to other 
devices, computers, networks, servers, etc. using either wired or wireless media. 
Altematively, the system components of a computer may in fact be embodied in a 
distributed computing system. For example, a terminal device may incorporate input and 
output devices to present only the user interface, whereas a processing component of the 
system are resident elsewhere. A phone may present web pages that are constructed on a 
remote server fi-om data resident on a database server somewhere else again. 

The exemplary computer 600 typically include at least some form of computer 
readable media. Computer readable media can be any available media that can be accessed 
by the computer. By way of example, and not limitation, computer readable media may 
comprise computer storage media and communication media. Computer storage media 
includes volatile and nonvolatile, removable and non-removable media implemented in any 
method or technology for storage of information such as computer readable instructions, 
data structures, program modules or other data. Computer storage media includes, but is not 
limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, 
digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, 
magnetic disk storage or other magnetic storage devices, or any other medium which can be 
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used to store the desired information and which can be accessed by the computer. 
Communication media typically embodies computer readable instructions, data structures, 
program modules or other data in a modulated data signal such as a carrier wave or other 
transport mechanism and includes any information delivery media. The term "modulated 
data signal" means a signal that has one or more of its characteristics set or changed in such 
a manner as to encode information in the signal. By way of example, and not limitation, 
conmiunication media includes wired media such as a wired network or direct-wired 
connection, and wireless media such as acoustic, RF, infrared and other wireless media. 
Combinations of any of the above should also be included within the scope of computer 
readable media. 

The exemplary computer 600 incorporating the illustrated imaging system 100 can 
be a personal computer, computer workstation, server computer, laptop, handheld computer. 
Alternatively, the exemplary computer 600 incorporating the illustrated imaging system 100 
can be a device with embedded computing capability, such as a computer peripheral device, 
audio-video equipment, scanner, printer, camera, television, set-top box, game console, 
vehicle navigation system, among others. 

The invention also has application outside of color space conversion of images in 
other applications where rapid evaluation of a computationally expensive power function is 
required. These other applications can include perceptual/physical conversion of audio, 
touch and other sensory data. In an alternative embodiment of the invention for such other 
applications, the computationally expensive power function is approximated by evaluating 
an expression mathematically combining computationally less expensive floating point 
operations. The computationally expensive floating point operations can be composed of a 
small number of square roots, reciprocal square roots, reciprocals, multiplications and/or 
additions and subtractions. The combination of these computationally less expensive 
functions can be an arithmetic mean, harmonic mean, weighted sum or difference, or other 
mathematical combination of the functions. In the alternative embodiment, an evaluator 
implementing the power function approximating expression is incorporated into a software 
system or subsystem (e.g., an audio system, touch/force-feedback system, etc.) that performs 
the other application. 
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Having described and illustrated the principles of our invention with reference to an 
illustrated embodiment, it will be recognized that the illustrated embodiment can be 
modified in arrangement and detail without departing fi-om such principles. It should be 
understood that the programs, processes, or methods described herein are not related or 
limited to any particular type of computer apparatus, unless indicated otherwise. Various 
types of general purpose or specialized computer apparatus may be used with or perform 
operations in accordance with the teachings described herein. Elements of the illustrated 
embodiment shown in software may be implemented in hardware and vice versa. 

In view of the many possible embodiments to which the principles of our invention 
may be applied, it should be recognized that the detailed embodiments are illustrative only 
and should not be taken as limiting the scope of our invention. Rather, we claim as our 
invention all such embodiments as may come within the scope and spirit of the following 
claims and equivalents thereto. 
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